Binaural hearing assistance system comprising a database of head related transfer functions

ABSTRACT

The application relates to a binaural hearing assistance system comprising left and right hearing assistance devices adapted for being located at or in a left and right ear, respectively, of a user, each of the left and right hearing assistance devices comprising a) an input unit for providing one or more electric input signals based on one or more input sounds of a sound field surrounding the binaural hearing assistance system; b) a source separation unit for separating and localizing one or more sound sources S s  in said sound field relative to the input transducer unit based on said one or more electric input signals, and providing respective separated sound source signals X s , and localization parameters LP s  of said one or more sound sources (s=1, 2, . . . , N s ); c) an antenna and transceiver unit adapted for allowing an exchange of said electric input signals, and/or said separated sound source signals X s  and/or said localization parameters LP s  of said one or more sound sources between said left and right hearing assistance devices. The application further relates to a method of operating a binaural hearing assistance system. The object of the present application is to provide an improved binaural hearing assistance system. The problem is solved in that the system further comprises d) a comparison and calculation unit for comparing said electric input signals, and/or said separated sound source signals X s   l , X s   r  and/or said localization parameters LP s   l , LP s   r  of said left and right hearing assistance devices, respectively, to estimate a head related transfer function HRTF value for one or more of said sound sources S with said localization parameters LP s  at a given point in time; and e) a memory unit for storing and updating a database of said HRTF values and optionally said localization parameters LP s  over time. This has the advantage of providing a flexible binaural hearing assistance system that is capable of learning the relevant HRTFs of its user, optionally without being initialized. The invention may e.g. be used in hearing aids, headsets, ear phones, active ear protection systems and combinations thereof.

This application is a Divisional of copending application Ser. No.14/531,415, filed on Nov. 3, 2014, which claims priority under 35 U.S.C.§120. This application claims priority of Application EP 13191567.0filed in Europe on Nov. 5, 2013, under 35 U.S.C. §119, all of which arehereby expressly incorporated by reference into the present application.

TECHNICAL FIELD

The present application relates to hearing assistance devices, inparticular to a binaural hearing assistance system comprising left andright hearing assistance devices adapted for being located at and/or ina left and right ear of a user, respectively, or fully or partiallyimplanted in the head of a user. The disclosure relates specifically toa binaural hearing assistance system configured to build a database ofthe user's head related transfer functions.

The application furthermore relates to a method of operating a hearingassistance system comprising left and right hearing assistance devices.The application further relates to a data processing system comprising aprocessor and program code means for causing the processor to perform atleast some of the steps of the method.

Embodiments of the disclosure may e.g. be useful in hearing aids,headsets, ear phones, active ear protection systems and combinationsthereof.

BACKGROUND

The following account of the prior art relates to one of the areas ofapplication of the present application, hearing aids.

The human ability to spatially localize a sound source is to a largeextent dependent on perception of the sound at both ears. Due todifferent physical distances between the sound source and the left andright ears, a difference in time of arrival of a given wavefront of thesound at the left and right ears is experienced (the Interaural TimeDifference, ITD). Consequently, a difference in phase of the soundsignal (at a given point in time) will likewise be experienced and inparticular perceivable at relatively low frequencies (e.g. below 1500Hz). Due to the shadowing effect of the head (diffraction), a differencein level of the received sound signal at the left and right ears islikewise experienced (the Interaural Level Difference, ILD). Theattenuation by the head (and body) is larger at relatively higherfrequencies (e.g. above 1500 Hz). The detection of the cues provided bythe ITD and ILD largely determine our ability to localize a sound sourcein a horizontal plane (i.e. perpendicular to a longitudinal direction ofa standing person). The diffraction of sound by the head (and body) isdescribed by the Head Related Transfer Functions (HRTF). The HRTF forthe left and right ears ideally describe respective transfer functionsfrom a sound source (from a given direction) to the ear drums of theleft and right ears. If correctly determined, the HRTFs provide therelevant ITD and ILD between the left and right ears for a givendirection of sound relative to the user's ears. Such HRTF_(left) andHRTF_(right) are preferably applied to a sound signal received by a leftand right hearing assistance device in order to improve a user's soundlocalization ability (cf. e.g. Chapter 14 of [Dillon; 2001]).

Several methods of generating HRTFs are known. Standard HRTFs from adummy head can e.g. be provided, as e.g. derived from Gardner andMartin's KEMAR HRTF database [Gardner and Martin, 1994] and applied tosound signals received by left and right hearing assistance devices of aspecific user. Alternatively, a direct measurement of the user's HRTF,e.g. during a fitting session can—in principle—be performed, and theresults thereof be stored in a memory of the respective (left and right)hearing assistance devices. During use, e.g. in case the hearingassistance device is of the Behind The Ear (BTE) type, where themicrophone(s) that pick up the sound typically are located near the topof (and often, a little behind) pinna, a direction of impingement of thesound source is determined by each device, and the respective relativeHRTFs are applied to the (raw) microphone signal to (re)establish therelevant localization cues in the signal presented to the user.

WO2010115227A1 describes a method and system for allowing a recipient ofa bilateral hearing aid system, to locate the source of a sound signalabout the recipient using localization cues (e.g. interaural leveldifference (ILD)) in the sound signal, which are modified (e.g.transposed to a lower frequency) to provide useable localization cues togenerate a stimulating signal for application to the recipient.

US2004218771A1 describes a method for producing an approximated partialtransfer function for use in an electroacoustic appliance for producingan environment correction transfer function that matches an appliancetransfer function for the electroacoustic appliance to an acousticenvironment. An environment correction transfer function to standardHRTFs is determined, the correction determining the partial transferfunction due to the specific environmental conditions and the particularhearing aid used.

WO2009001277A1 describes a binaural object-oriented audio decoder forproviding an enhanced binaural object-oriented audio decoder bymodifying the received head-related transfer function parametersaccording to a received desired distance, which allows an arbitraryvirtual positioning of objects in a space.

SUMMARY

In the present disclosure, a binaural fitting is intended to mean ahearing assistance device-pair adapted to be able to exchange databetween them, ‘data’ being audio signals, control signals, and/or otherparameters. According to the present disclosure—with a binauralfitting—it is possible to learn the individual Head Related TransferFunctions (HRTF's) from the sources over a given time, which will allowthe device to modify the position of nearby sound sources or positionvirtual sources. With this approach it is possible to skip themeasurement (or estimate) of the individual HRTF during hearinginstrument fitting. A bilateral fitting, on the other hand, is intendedto mean a hearing assistance device-pair adapted for being worn at bothears of a user, but lacking the capability of exchanging data betweenthem.

EP 2 563 045 A1 states that with a binaural fit, it is possible to learnthe HRTF's from the sources over a given time. When the HRTF's have beenlearned it is possible to switch to the bilateral BEE estimation tominimize the inter-instrument communication. With this approach it ispossible to skip the measurement of the HRTF during hearing instrumentfitting, and minimize the power consumption from inter-instrumentcommunication. Whenever the set of hearing instruments have found thatthe difference in chosen frequency bands is sufficiently small betweenthe binaural and bilateral estimation for a given spatial location, theinstrument can rely on the bilateral estimation method for that spatiallocation.

An object of the present application is to provide an adaptive andimproved binaural hearing assistance system.

Objects of the application are achieved by the invention described inthe accompanying claims and as described in the following.

A Binaural Hearing Assistance System:

In an aspect, an object of the application is achieved by a binauralhearing assistance system comprising left and right hearing assistancedevices adapted for being located at or in a left and right ear,respectively, of a user (or fully or partially implemented in the head,e.g. at the left and right ear of the user), each of the left and righthearing assistance devices comprising

-   an input unit for providing one or more electric input signals based    on one or more input sounds of a sound field surrounding the    binaural hearing assistance system;-   a source separation unit for separating and localizing one or more    sound sources S_(s) in said sound field relative to the input    transducer unit based on said one or more electric input signals,    and providing respective separated sound source signals X_(s), and    localization parameters LPs of said one or more sound sources (s=1,    2, . . . , N_(s));-   an antenna and transceiver unit adapted for allowing an exchange of    said electric input signals and/or said separated sound source    signals Xs and/or said localization parameters LPs of said one or    more sound sources between said left and right hearing assistance    devices.

Each hearing assistance device further comprises,

-   a comparison and calculation unit for comparing said electric input    signals and/or said separated sound source signals X_(s) ^(l), X_(s)    ^(r) of said left and right hearing assistance devices,    respectively, to estimate a head related transfer function HRTF    value for one or more of said sound sources S with said localization    parameters LP_(s), at a given point in time; and-   a memory unit for storing and updating a database of said HRTF    values over time.

This has the advantage of providing a flexible binaural hearingassistance system that is capable of learning the relevant HRTFs of itsuser.

In an embodiment, the database of HRTF values initially comprisesstandard HRTF-data, e.g. from a dummy head, e.g. derived from Gardnerand Martin's KEMAR HRTF database or otherwise measured or estimatedHRTF-values. In an embodiment, the database of HRTF values is initiallyempty (so that the binaural hearing assistance system (without priorknowledge of any HRTF-values) gradually improves and learns theHRTF-values for the particular user of the system).

In an embodiment, the binaural hearing assistance system is configuredto provide that said HRTF values are updated according to a criterion orlearning rule.

In an embodiment, the HRTF values are relative values (indicative of arelative difference between the head related transfer functions for theright and left ears). In an embodiment, each HRTF values is (or can be)expressed as a complex number (for a given source and location of thesource relative the user). In an embodiment, the HRTF value for a givensource and location of the source relative the user is a complex numberindicative of a relative difference between the head related transferfunctions for the right and left ears. In an embodiment, the HRTF-valueis expressed as a ratio of the head related transfer functions for theright and left ears, HRTF=HRTF_(r)/HRTF_(l).

In an embodiment, the binaural hearing assistance system is configuredto provide that a HRTF value is updated when a difference measure ΔHRTFbetween a currently estimated HRTF value and a corresponding HRTF valuestored in the database is larger than a threshold value ΔHRTF_(TH) (e.g.a complex threshold value, e.g. so that the real and imaginary (ormagnitude and phase) parts of the difference measure ΔHRTF are evaluatedseparately). The difference measure may be based on ratios, ordifferences of the relevant current and stored HRTF values (orfunctional values thereof, e.g. logarithmic or absolute value).

Online Learning of HRTF

Given a source signal S_(s) at a given position θ_(s), φ_(s), d_(s),relative to the microphone, the ratio between the corresponding signalsthat reaches the right and left microphones is

$\frac{X_{s}^{r}\left\lbrack {n,k} \right\rbrack}{X_{s}^{l}\left\lbrack {n,k} \right\rbrack} = {\frac{{{HRTF}_{r}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{S_{s}\left\lbrack {n,k} \right\rbrack}}{{{HRTF}_{l}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{S_{s}\left\lbrack {n,k} \right\rbrack}} = \frac{{HRTF}_{r}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{{HRTF}_{l}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}}$

The ratio can be split into the magnitude part that contains theInteraural Level Difference (ILD) indexed by the position parameters(with its notational short form A_(s)) and the timing part, theInteraural Time Difference (ITD) indexed by the position parameters(with its notational short form Θ_(s)).

${I\; L\; {D\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}} = {\frac{{X_{s}^{r}\left\lbrack {n,k} \right\rbrack}}{{X_{s}^{l}\left\lbrack {n,k} \right\rbrack}} = {A_{s}\lbrack k\rbrack}}$${I\; T\; {D\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}} = {\frac{{\angle \left\{ {X_{s}^{r}\left\lbrack {n,k} \right\rbrack} \right\}} - {\angle \left\{ {X_{s}^{l}\left\lbrack {n,k} \right\rbrack} \right\}}}{2\; \pi \; {f(k)}} = {\Theta_{s}\lbrack k\rbrack}}$and  thus  X_(s)^(r)[n, k] = A_(s)[k]X_(s)^(l)[n, k]^(−2 π j Θ_(s)[k])

-   where-   S_(s), source signal and S_(s)[n, k] source signal in filter bank    representation-   M^(r) microphone signal at right microphone-   X_(s) ^(r) source s signal at right microphone-   n time index-   k frequency index-   s source index-   θ_(s) horizontal angle of incidence for source s-   Φ_(s) vertical angle of incidence for source s-   HRT F_(r) head related transfer function for sound originating from    ∠θ_(s), ∠φ_(s)-   d_(s) distance of source s (right microphone)

In other words, the relative head related transfer functions HRTF, whichreflect the difference between the transfer functions from the sound thesource in question (S_(s)) to the right and left ears (microphones) ofthe user, can be written as the complex number:

${{HRTF}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack} = {\frac{{HRTF}_{r}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{{HRTF}_{l}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack} = \frac{X_{s}^{r}\left\lbrack {n,k} \right\rbrack}{X_{s}^{l}\left\lbrack {n,k} \right\rbrack}}$HRTF[k, θ_(s), φ_(s), d_(s)] = A_(s)[k]^(−2 π j Θ_(s)[k]) = I L D[k, θ_(s), φ_(s), d_(s)]^(−2 j ITD[k, θ_(s), φ_(s), d_(s)])

According to the present disclosure, the obtained estimates of thetransfer function between the two ears (A_(s)[k] and Θ_(s)[k]) arecontinuously compared (e.g. for all values of the time index n; or atpredefined points in time, e.g. periodically, e.g. with a predefinedfrequency) to the (or a) representation of the wearer's individual HRTFin the database for the corresponding or nearest position.

In an embodiment, the system is configured so that whenever the set ofhearing instruments (hearing assistance devices) have found that thedifference (A_(s)[k], Θ_(s)[k]) in chosen frequency bands (κ) is greaterthan the learning threshold τ_(A) or τ_(Θ) between stored and theestimated values for the given location (θ_(s), φ_(s), d_(s)), theinstrument (hearing assistance device) can update the HRTF databaseaccording to a learning rule.

In an embodiment, the learning rule comprises that said HRTF values areupdated at a given point in time (and possibly at a given frequency orfrequency band) if the deviation exceeds the learning thresholds τ_(A)and τ_(Θ), where τ_(A) relates to the Interaural Level Difference (ILD)indexed by the position parameters (with its notational short formA_(s)) and where and τ_(Θ), relates to the Interaural Time Difference(ITD) indexed by the position parameters (with its notational short formΘ_(s)).

In an embodiment, the learning rule is linear with a memory factor α,where 0<α<1.

HRTF_(database) [k, θ_(s), φ_(s) , d _(s)]=HRTF_(database) [k, θ_(s),φ_(s) , d _(s)](1−α)+αA _(s) [k]e ^(−πjΘ) _(s) [k].

The learning thresholds τ_(A) and τ_(Θ) may furthermore be madefrequency dependent (e.g. dependent on frequency index k). In anembodiment, the learning thresholds are different above and below athreshold frequency (e.g. 1500 Hz) and relatively smaller where thedifference in question (ITD or ILD) is the more sensitive, andrelatively higher where the difference in question (ITD or ILD) is theless sensitive.

In an embodiment, the hearing assistance devices comprise ananalogue-to-digital (AD) converter to digitize an analogue input with apredefined sampling rate, e.g. 20 kHz. In an embodiment, the hearingassistance devices comprise a digital-to-analogue (DA) converter toconvert a digital signal to an analogue output signal, e.g. for beingpresented to a user via an output transducer.

In an embodiment, the binaural hearing assistance system comprises atime to time frequency (TF) conversion unit for presenting said one ormore time variant electric input signals x(n) in a time-frequencyrepresentation X(n,k), where n is a time index and κ is a frequencyindex. In an embodiment, the source separation unit is configured toprovide a time-frequency representation X_(s)(n,k) of said separatedsound source signals X_(s) (and/or said electric input signals)

In an embodiment, each hearing assistance device, e.g. the input unit,comprise(s) a TF-conversion unit for providing a time-frequencyrepresentation of an input signal. In an embodiment, the time-frequencyrepresentation comprises an array or map of corresponding complex orreal values of the signal in question in a particular time and frequencyrange. In an embodiment, the TF conversion unit comprises a filter bankfor filtering a (time varying) input signal and providing a number of(time varying) output signals each comprising a distinct frequency rangeof the input signal. In an embodiment, the TF conversion unit comprisesa Fourier transformation unit (e.g. based on an FFT-, e.g. aDFT-algorithm) for converting a time variant input signal to a (timevariant) signal in the frequency domain. In an embodiment, the frequencyrange considered by the hearing assistance device from a minimumfrequency f_(min) to a maximum frequency f_(max) comprises a part of thetypical human audible frequency range from 20 Hz to 20 kHz, e.g. a partof the range from 20 Hz to 12 kHz. In an embodiment, a signal of theforward and/or analysis path of the hearing assistance device is splitinto a number NI of frequency bands, where NI is e.g. larger than 5,such as larger than 10, such as larger than 50, such as larger than 100,such as larger than 500, at least some of which are processedindividually. In an embodiment, the hearing assistance device is/areadapted to process a signal of the forward and/or analysis path in anumber NP of different frequency channels (NP≦NI). The frequencychannels may be uniform or non-uniform in width (e.g. increasing inwidth with frequency), overlapping or non-overlapping.

In an embodiment, the localization parameters LP_(s) ^(l) and LP_(s)^(r) of the left and right hearing assistance device, respectively, of asound source S_(s) comprises estimates of coordinates of said soundsource relative to an input unit or transducer of the respective leftand right hearing assistance device, or relative to the hearingassistance device itself.

In an embodiment, the input unit of a hearing assistance devicecomprises a number of input transducers, e.g. two or more inputtransducers. In an embodiment, an input transducer comprises amicrophone. In an embodiment, an input transducer comprises a wirelessreceiver. In an embodiment, an input transducer is adapted forconverting an input sound to an electric input signal. In an embodiment,an input transducer comprises a microphone, e.g. a directional or anomni-directional microphone. In an embodiment, the hearing assistancesystem (e.g. each hearing assistance device, e.g. embodied in the inputunit and/or the source separation unit) comprises a directionalmicrophone system adapted to enhance a target acoustic source among amultitude of acoustic sources in the local environment of the userwearing the hearing assistance system. In an embodiment, the directionalsystem is adapted to detect (such as adaptively detect) from whichdirection (and/or e.g. from which distance) a particular part of themicrophone signal (e.g. a particular sound source) originates. This canbe achieved in various different ways as e.g. described in the priorart.

In an embodiment, the input unit comprises an antenna and transceivercircuitry for wirelessly receiving a direct electric input signal fromanother device, e.g. a communication device or another hearingassistance device. In an embodiment, the direct electric input signalrepresents or comprises an audio signal and/or a control signal and/oran information signal. In an embodiment, the transceiver circuitrycomprises demodulation circuitry for demodulating the received directelectric input to provide the direct electric input signal representingan audio signal and/or a control signal. In general, the wireless linkestablished by the antenna and transceiver circuitry of the hearingassistance device can be of any type. In an embodiment, the wirelesslink is used under power constraints, e.g. in that the hearingassistance device is or comprises a portable (typically battery driven)device. In an embodiment, the wireless link is a link based onnear-field communication, e.g. an inductive link based on an inductivecoupling between antenna coils of transmitter and receiver parts. Inanother embodiment, the wireless link is based on far-field,electromagnetic radiation (radiated fields (RF)). In an embodiment, thewireless link is based on a standardized or proprietary technology. Inan embodiment, the wireless link is based on Bluetooth technology (e.g.Bluetooth Low-Energy technology).

In an embodiment, the localization parameters (e.g. absolute or relativespatial coordinates) of the sound source S_(s) (s=1, 2, . . . , Ns) inthe left and right hearing assistance devices are referred to acoordinate system having its center midway between the left and righthearing assistance devices, when operationally mounted on (or implantedin) the user (i.e. typically midway between the ears of the user, cf.e.g. FIG. 1C). In an embodiment, the separated sound source signalsX_(s) ^(l), X_(s) ^(r) and the corresponding localization parametersLP_(s) ^(l), LP_(s) ^(r) of the left and right hearing assistancedevices are exchanged between the left and right hearing assistancedevices. During learning of HRTF's, similarities (or differences) in thelocalization parameters determined in each of the hearing assistancedevices for a given sound source (as seen from the midpoint between theears) reveals how much the devices agree (or disagree). For sources infront of the listener, the degree to which the location of such sourcescoincide (e.g. an absolute or relative deviation between thelocalization parameters of the left and right hearing assistancedevices) represent an estimation of an accuracy measure, which can beused to decide how much an observation should be allowed to update theHRTF database (e.g. determine a weight of the new value in an updatealgorithm, cf. e.g. parameter α in the learning rule exemplified above).

In an embodiment, some or all of the electric input signals, some or allof the separated sound source signals X_(s) ^(l), X_(s) ^(r), and someor all of the localization parameters are exchanged between the left andright hearing assistance devices (i.e. the localization parameters arenot exchanged).

In an embodiment (e.g. in a specific first mode of operation), only theseparated sound source signals X_(s) ^(l), X_(s) ^(r) are exchangedbetween the left and right hearing assistance devices (i.e. thelocalization parameters are not exchanged).

In an embodiment (e.g. in a specific second mode of operation), only thelocalization parameters LP_(s) ^(l), LP_(s) ^(r) are exchanged betweenthe left and right hearing assistance devices (i.e. the separated soundsource signals are not exchanged). During use of the learned HRTF,exchange of the localization parameters requires less bandwidth thanexchange of separated audio signals.

In an embodiment (e.g. in a specific third mode of operation), theseparated sound source signals as well as the corresponding localizationparameters are exchanged between the left and right hearing assistancedevices.

In an embodiment (e.g. in a specific fourth mode of operation), soundsource signals for selected sources and/or localization parameters ofthe same and/or other sound sources are exchanged between the left andright hearing assistance devices.

In an embodiment, the left and right hearing assistance devices areconfigured to enable access to the HRTF-database of the respective otherhearing assistance device and to import said electric input signals,and/or separated sound source signals and/or localization parameters forsaid sources from the other (opposite) hearing assistance device. Thisallows e.g. the hearing assistance devices to probe each other aboutcurrently dominant sound sources and/or their spatial directions.

Exchanging the localization parameters, and including both entries (ofthe left and right devise) in the HRTF tables of each hearing assistancedevice has the potential advantage of improving the HRTF-accuracy.

Applying a HRTF to a Signal

In an embodiment, each of the left and right hearing assistance devicescomprises an HRTF-control unit for applying a HRTF-value to at least oneof said separated sound source signals (and/or to at least one of theelectric input signals). The HRTF value is preferably selected from thedatabase of HRTF values corresponding the location of the separatedsound source in question.

The transfer functions in the HRTF database may, alternatively oradditionally, be applied to sound signals X_(e) received through otherchannels than the microphones (e.g. via a wireless reciver), e.g. bystreaming, Direct Audio Input (DAI), telecoil, etc., i.e. signals thathave not been exposed to the physical HRTF of the wearer.

In an embodiment, at least one of the left and right hearing assistancedevices comprises an audio input for receiving a direct electric inputsignal representing a sound source signal of a real or virtual soundsource, and where said at least one of the left and right hearingassistance devices is configured to estimate a location of a real orvirtual sound source and to apply a corresponding HRTF from the databaseto said direct electric input signal.

Given that the signal X_(e) is to be placed at position (θ_(e), φ_(e),d_(e)) the corresponding device signals can be written as

${Y_{e}^{r}\left\lbrack {n,k} \right\rbrack} = {\frac{{HRTF}_{database}\left\lbrack {k,\theta_{e},\varphi_{e},d_{e}} \right\rbrack}{2}{X_{e}\left\lbrack {n,k} \right\rbrack}}$${Y_{e}^{l}\left\lbrack {n,k} \right\rbrack} = {\frac{2}{{HRTF}_{database}\left\lbrack {k,\theta_{e},\varphi_{e},d_{e}} \right\rbrack}{X_{e}\left\lbrack {n,k} \right\rbrack}}$

In other words, the relative HRTF accounts for the difference betweenthe sound from a given source S_(e) at the right and left ears. This‘difference’ can then be applied to a signal without directional cues(X_(e) e.g. a directly received electric signal, e.g. a streamedsignal). Thereby the time and level differences normally accounted forby the different locations of the ears relative to the sound source andto the shadowing effect of the human head (etc.) can be applied to asignal (X_(e)) without directional cues (to thereby e.g. virtually‘placing’ a directly received electric signal in the environment aroundthe user).

For a multi channel input signal X_(E), each channel can be consideredas a sum of individual signals X_(e1-eM) with individual position in thetwo equations above, i.e.

Y _(E) ^(r) [n, k]=Σ_(e) _(l) _(=1:M) Y _(el) ^(r) [n, k].

In an embodiment, the localization parameters comprise (or isconstituted by) a direction (e.g. from the input unit or transducer orhearing assistance device in question) to the real or virtual soundsource. In an embodiment, the sound represented by the direct electricinput is a single channel sound (mono), or alternatively a multichannelsound where each channel has its own position. In an embodiment, thebinaural hearing assistance system is configured to estimate theposition of the sound source from the direction to the origin of thesound source (or direct electric signal). In an embodiment, the binauralhearing assistance system is configured to exchange localization data of(e.g. the position of and/or direction to) the sound source between thetwo hearing assistance devices.

In an embodiment, each of the left and right hearing assistance devicescomprises a signal processing unit for processing an input signalselected among said electric input signals, and/or said separated soundsource signals or a mixture thereof. In an embodiment, the hearingassistance device is adapted to provide a frequency dependent gain tocompensate for a hearing loss of a user. In an embodiment, the hearingassistance device comprises a signal processing unit for enhancing theinput signals and providing a processed output signal. Various aspectsof digital hearing aids are described in [Schaub; 2008].

In an embodiment, at least one of (such as each of) the left and righthearing assistance devices comprises an output unit for providing outputstimuli to the user based on a processed signal, wherein said outputstimuli are perceived by the user as sound. In an embodiment, the outputunit comprises an output transducer for converting an electric signal toa stimulus perceived by the user as an acoustic signal. In anembodiment, the output unit comprises a number of electrodes of acochlear implant or a vibrator of a bone conducting hearing assistancedevice. In an embodiment, the output transducer comprises a receiver(speaker) for providing the stimulus as an acoustic signal to the user.

In an embodiment, each of the left and right hearing assistance devicescomprises a forward signal path between said input and output units, theforward path comprising a signal processing unit operatively connectedto an output of the input unit and an input of the output unit, thesignal processing unit being configured to apply a processing algorithmto an input signal and provide a processed output signal. In anembodiment, each of the left and right hearing assistance devicescomprises an analysis path comprising functional components foranalyzing the input signal (e.g. determining a level, a modulation, atype of signal, an acoustic feedback estimate, etc.). In an embodiment,some or all signal processing of the analysis path and/or the signalpath is conducted in the frequency domain. In an embodiment, some or allsignal processing of the analysis path and/or the signal path isconducted in the time domain.

Manipulating the Position of a Signal

In an embodiment, the binaural hearing assistance system comprises auser interface (e.g. a remote control, e.g. implemented as an APP of aSmartPhone) from which a user can select a suitable position, e.g. by‘placing’ a sound source in the current acoustic environment (e.g. via agraphical interface illustrating currently active (real or virtual, e.g.directly received sound signals) sound source(s) relative to the user).In an embodiment, the binaural hearing assistance system is configuredto update localization parameters of a sound source in the memory unitof the left and right hearing assistance devices, based on inputs from auser interface. In an embodiment, the binaural hearing assistance systemis configured to allow a user to select a particular sound source signalto be included in the output signal to the user via the user interface.

The HRTF database also allows for manipulation of the perceived positionof sounds that have been affected by the wearer's HRTF. Modifying theperceived location of a signal is a two step procedure where theresulting signals Y_(e) ^(lr) undergo a compensation for the HRTFcorresponding to the signal's physical position and application of theHRTF corresponding to the chosen perceived position. For instance, thisallows device-pairs to increase the perceived distance betweenconcurrent sounds.

${Y_{e}^{r}\left\lbrack {n,k} \right\rbrack} = {\frac{{HRTF}_{database}\left\lbrack {k,\theta_{e},\varphi_{e},d_{e}} \right\rbrack}{{HRTF}_{database}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{X_{s}^{r}\left\lbrack {n,k} \right\rbrack}}$${Y_{e}^{l}\left\lbrack {n,k} \right\rbrack} = {\frac{{HRTF}_{database}\left\lbrack {k,\theta_{s},\varphi_{s},d_{s}} \right\rbrack}{{HRTF}_{database}\left\lbrack {k,\theta_{e},\varphi_{e},d_{e}} \right\rbrack}{X_{s}^{l}\left\lbrack {n,k} \right\rbrack}}$

In an embodiment, the binaural hearing assistance system comprises anauxiliary device (e.g. a remote control, e.g. a cellphone, e.g. aSmartPhone) wherein the user interface is implemented.

In an embodiment, the system is adapted to establish a communicationlink between the hearing assistance device(s) and the auxiliary deviceto provide that information (e.g. control and status signals, possiblyaudio signals) can be exchanged or forwarded from one to the other.

In an embodiment, the auxiliary device is or comprises an audio gatewaydevice adapted for receiving a multitude of audio signals (e.g. from anentertainment device, e.g. a TV or a music player, a telephoneapparatus, e.g. a mobile telephone or a computer, e.g. a PC) and adaptedfor selecting and/or combining an appropriate one of the received audiosignals (or combination of signals) for transmission to the hearingassistance device. In an embodiment, the auxiliary device is orcomprises a remote control for controlling functionality and operationof the hearing assistance device(s). In an embodiment, the auxiliarydevice is or comprises a cellphone, e.g. a SmartPhone. In an embodiment,processing of the system (e.g. sound source separation) and/or thefunction of a remote control is fully or partially implemented in aSmartPhone, the SmartPhone possibly running an APP allowing to controlthe functionality of the audio processing device via the SmartPhoneand/or to provide a user interface (the hearing assistance device(s)comprising an appropriate wireless interface to the SmartPhone, e.g.based on Bluetooth or some other standardized or proprietary scheme).

In the present context, a SmartPhone is a portable electronic devicethat may comprise

-   a (A) cellular telephone comprising a microphone, a speaker, and a    (wireless) interface to the public switched telephone network (PSTN)    COMBINED with-   a (B) personal computer comprising a processor, a memory, an    operative system (OS), a user interface (e.g. a keyboard and    display, e.g. integrated in a touch sensitive display) and a    wireless data interface (including a Web-browser), allowing a user    to download and execute application programs (APPs) implementing    specific functional features (e.g. displaying information retrieved    from the Internet, remotely controlling another device, combining    information from various sensors of the SmartPhone (e.g. camera,    scanner, GPS, microphone, etc.) and/or external sensors to provide    special features, etc.).

In an embodiment, the binaural hearing assistance system is configuredto allow a user to modify a location of a sound source whose locationhas been determined by the source separation unit (or receivedseparately for a wirelessly received direct electric signal) via theuser interface and to apply the HRTF values to the sound source signal,the HRTF values being extracted from the HRTF database corresponding tothe modified location of the sound source. Thereby, the user is allowedto manipulate the sound field by placing one or more sound sources atanother position than its/their physical (or otherwise proposed)location. In an embodiment, the sound signal from the sound source whoselocation has been modified via the user interface represents a singlechannel sound (mono) or a multichannel sound where each channel has itsown position.

In an embodiment, the binaural hearing assistance system comprises alocalization unit (e.g. embodied in at least one of, such as each of,the hearing assistance devices, or in an auxiliary device) where theposition of the sound source is estimated by other means than the soundsignal, i.e. by an independent localization unit in the device-pair,including outputs from the wireless/radio communication etc. In anembodiment, the binaural hearing assistance system comprises alocalization extracting unit (e.g. embodied in at least one of, such aseach of, the hearing assistance devices, or in an auxiliary device)configured to extract localization parameters intended for representingthe perceived location of a specific sound. In an embodiment, thebinaural hearing assistance system comprises an antenna and transceiverunit for receiving a signal comprising the localization parameters. Inan embodiment, the localization extracting unit is configured to extractlocalization parameters embedded in an audio signal representing a soundsource signal. In an embodiment, at least one of the hearing assistancedevices comprise a localization extracting unit.

Detectors:

In an embodiment, the binaural hearing assistance system (e.g. one ofthe hearing assistance devices or an auxiliary device) comprises one ormore detectors, e.g. configured to provide signals relating to a currentproperty of ‘the physical environment’ of the hearing assistance system,e.g. to provide parameters of the acoustic environment.

In an embodiment, the hearing assistance device comprises a leveldetector (LD) for determining the level of an input signal (e.g. on aband level and/or of the full (wide band) signal). The input level ofthe electric microphone signal picked up from the user's acousticenvironment is e.g. a classifier of the environment.

In a particular embodiment, the hearing assistance device comprises avoice activity detector (VAD) for determining whether or not an inputsignal comprises a voice signal (at a given point in time). This has theadvantage that time segments of the electric microphone signalcomprising human utterances (e.g. speech) in the user's environment canbe identified, and thus separated from time segments only comprisingother sound sources (e.g. artificially generated noise). In anembodiment, the voice detector is adapted to detect as a VOICE also theuser's own voice. Alternatively, the voice detector is adapted toexclude a user's own voice from the detection of a VOICE. In anembodiment, the hearing assistance system is configured to identify thesound sources that comprise speech (and e.g.—in a particular speechmode—exclude sources that are not identified as (currently) comprisingspeech).

In a particular embodiment, the hearing assistance device comprises afeedback detector (e.g. a tone detector in combination with adiscriminator of whether a detected tone is due to feedback or not). Ina particular embodiment, the hearing assistance device comprises adetector of music, e.g. based on the feedback detector).

Other Functionality:

In an embodiment, the hearing assistance device comprises an acoustic(and/or mechanical) feedback suppression system. In an embodiment, thehearing assistance device further comprises other relevant functionalityfor the application in question, e.g. compression, noise reduction, etc.

In an embodiment, the hearing assistance device comprises a listeningdevice, e.g. a hearing aid, e.g. a hearing instrument, e.g. a hearinginstrument adapted for being located at the ear or fully or partially inthe ear canal of a user or for being fully or partially implanted in auser's head, or a headset, an earphone, an ear protection device or acombination thereof.

Use:

In an aspect, use of a binaural hearing assistance system as describedabove, in the ‘detailed description of embodiments’ and in the claims,is moreover provided. In an embodiment, use is provided in a systemcomprising one or more hearing instruments, headsets, ear phones, activeear protection systems, etc., e.g. in handsfree telephone systems,teleconferencing systems, public address systems, karaoke systems,classroom amplification systems, etc.

A Method:

In an aspect, a method of operating a binaural hearing assistance systemcomprising left and right hearing assistance devices is furthermoreprovided, the method comprising in each of the left and right hearingassistance devices:

-   providing one or more electric input signals based on one or more    input sounds of a sound field surrounding the binaural hearing    assistance system;-   separating and localizing one or more sound sources S_(s) in said    sound field relative to the input transducer unit based on said one    or more electric input signals, and providing respective separated    sound source signals X_(s), and localization parameters LP_(s) of    said one or more sound sources (s=1, 2, . . . , N_(s));-   exchanging of said electric input signals, and/or said separated    sound source signals X_(s) and/or said localization parameters    LP_(s) of said one or more sound sources between said left and right    hearing assistance devices;-   comparing said electric input signals, and/or said separated sound    source signals X_(s) ^(l), X_(s) ^(r) and/or said localization    parameters LP_(s) ^(l), LP_(s) ^(r) of said left and right hearing    assistance devices, respectively, to estimate a head related    transfer function HRTF value for one or more of said sound sources S    with said localization parameters LP_(s) at a given point in time;    and-   storing and updating a database of said HRTF values and optionally    said localization parameters LP_(s) over time.

It is intended that some or all of the structural features of the systemdescribed above, in the ‘detailed description of embodiments’ or in theclaims can be combined with embodiments of the method, whenappropriately substituted by a corresponding process and vice versa.Embodiments of the method have the same advantages as the correspondingsystem.

In an embodiment, the method provides that said HRTF values are updatedaccording to a criterion or learning rule. In an embodiment, the methodcomprises initially storing standard HRTF-data in the database, e.g.from a dummy head, e.g. derived from Gardner and Martin's KEMAR HRTFdatabase. During use of the binaural hearing assistance system, theinitially stored HRTF-data (e.g. standard data) are substituted byimproved (customized, learned) HRTF-data.

In an embodiment, the method provides that said criterion or learningrule comprises that a HRTF value is updated when a difference measureΔHRTF between a currently estimated HRTF value and a corresponding HRTFvalue stored in the database is larger than a threshold valueΔHRTF_(TH). In an embodiment, the method provides that said criterion orlearning rule comprises that said HRTF values are updated at a givenpoint in time, and optionally at a given frequency or frequency band, ifthe deviation between stored and current values of Interaural LevelDifference (ILD) and Interaural Time Difference (ITD), both beingindexed by the position parameters of the sound source in question,exceeds learning thresholds τ_(A) and τ_(Θ), where τ_(A) relates to ILDand where and τ_(Θ), relates ITD.

A Computer Readable Medium:

In an aspect, a tangible computer-readable medium storing a computerprogram comprising program code means for causing a data processingsystem to perform at least some (such as a majority or all) of the stepsof the method described above, in the ‘detailed description ofembodiments’ and in the claims, when said computer program is executedon the data processing system is furthermore provided by the presentapplication. In addition to being stored on a tangible medium such asdiskettes, CD-ROM-, DVD-, or hard disk media, or any other machinereadable medium, and used when read directly from such tangible media,the computer program can also be transmitted via a transmission mediumsuch as a wired or wireless link or a network, e.g. the Internet, andloaded into a data processing system for being executed at a locationdifferent from that of the tangible medium.

A Data Processing System:

In an aspect, a data processing system comprising a processor andprogram code means for causing the processor to perform at least some(such as a majority or all) of the steps of the method described above,in the ‘detailed description of embodiments’ and in the claims isfurthermore provided by the present application.

Definitions:

In the present context, a ‘hearing assistance device’ refers to adevice, such as e.g. a hearing instrument or an active ear-protectiondevice or other audio processing device, which is adapted to improve,augment and/or protect the hearing capability of a user by receivingacoustic signals from the user's surroundings, generating correspondingaudio signals, possibly modifying the audio signals and providing thepossibly modified audio signals as audible signals to at least one ofthe user's ears. A ‘hearing assistance device’ further refers to adevice such as an earphone or a headset adapted to receive audio signalselectronically, possibly modifying the audio signals and providing thepossibly modified audio signals as audible signals to at least one ofthe user's ears. Such audible signals may e.g. be provided in the formof acoustic signals radiated into the user's outer ears, acousticsignals transferred as mechanical vibrations to the user's inner earsthrough the bone structure of the user's head and/or through parts ofthe middle ear as well as electric signals transferred directly orindirectly to the cochlear nerve of the user.

The hearing assistance device may be configured to be worn in any knownway, e.g. as a unit arranged behind the ear with a tube leading radiatedacoustic signals into the ear canal or with a loudspeaker arranged closeto or in the ear canal, as a unit entirely or partly arranged in thepinna and/or in the ear canal, as a unit attached to a fixture implantedinto the skull bone, as an entirely or partly implanted unit, etc. Thehearing assistance device may comprise a single unit or several unitscommunicating electronically with each other.

More generally, a hearing assistance device comprises an inputtransducer for receiving an acoustic signal from a user's surroundingsand providing a corresponding input audio signal and/or a receiver forelectronically (i.e. wired or wirelessly) receiving an input audiosignal, a signal processing circuit for processing the input audiosignal and an output means for providing an audible signal to the userin dependence on the processed audio signal. In some hearing assistancedevices, an amplifier may constitute the signal processing circuit. Insome hearing assistance devices, the output means may comprise an outputtransducer, such as e.g. a loudspeaker for providing an air-borneacoustic signal or a vibrator for providing a structure-borne orliquid-borne acoustic signal. In some hearing assistance devices, theoutput means may comprise one or more output electrodes for providingelectric signals.

In some hearing assistance devices, the vibrator may be adapted toprovide a structure-borne acoustic signal transcutaneously orpercutaneously to the skull bone. In some hearing assistance devices,the vibrator may be implanted in the middle ear and/or in the inner ear.In some hearing assistance devices, the vibrator may be adapted toprovide a structure-borne acoustic signal to a middle-ear bone and/or tothe cochlea. In some hearing assistance devices, the vibrator may beadapted to provide a liquid-borne acoustic signal to the cochlearliquid, e.g. through the oval window. In some hearing assistancedevices, the output electrodes may be implanted in the cochlea or on theinside of the skull bone and may be adapted to provide the electricsignals to the hair cells of the cochlea, to one or more hearing nerves,to the auditory cortex and/or to other parts of the cerebral cortex.

A ‘listening system’ refers to a system comprising one or two hearingassistance devices, and a ‘binaural listening system’ refers to a systemcomprising one or two hearing assistance devices and being adapted tocooperatively provide audible signals to both of the user's ears.Listening systems or binaural listening systems may further comprise‘auxiliary devices’, which communicate with the hearing assistancedevices and affect and/or benefit from the function of the hearingassistance devices. Auxiliary devices may be e.g. remote controls, audiogateway devices, mobile phones, public-address systems, car audiosystems or music players. Hearing assistance devices, listening systemsor binaural listening systems may e.g. be used for compensating for ahearing-impaired person's loss of hearing capability, augmenting orprotecting a normal-hearing person's hearing capability and/or conveyingelectronic audio signals to a person.

Further objects of the application are achieved by the embodimentsdefined in the dependent claims and in the detailed description of theinvention.

As used herein, the singular forms “a,” “an,” and “the” are intended toinclude the plural forms as well (i.e. to have the meaning “at leastone”), unless expressly stated otherwise. It will be further understoodthat the terms “includes,” “comprises,” “including,” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof. It will also be understood that when an elementis referred to as being “connected” or “coupled” to another element, itcan be directly connected or coupled to the other element or interveningelements may be present, unless expressly stated otherwise. Furthermore,“connected” or “coupled” as used herein may include wirelessly connectedor coupled. As used herein, the term “and/or” includes any and allcombinations of one or more of the associated listed items. The steps ofany method disclosed herein do not have to be performed in the exactorder disclosed, unless expressly stated otherwise.

BRIEF DESCRIPTION OF DRAWINGS

The disclosure will be explained more fully below in connection with apreferred embodiment and with reference to the drawings in which:

FIG. 1A-FIG. 1D schematically illustrate various examples of a mutuallocation in space of elements of a binaural hearing assistance systemand/or a sound source, represented in a spherical and an orthogonalcoordinate system,

FIG. 2 shows an embodiment of a binural hearing assistance systemcomprising left and right hearing assistance devices and an auxiliarydevice, e.g. an audio gateway, the system being adapted for establishinga first (interaural) communication link between the two hearingassistance devices as well as for establishing a communication linkbetween each or the two hearing assistance devices and the auxiliarydevice,

FIG. 3A-FIG. 3B show an embodiment of a binaural hearing assistancesystem comprising left and right hearing assistance devices,

FIG. 4 shows an embodiment of a binaural hearing assistance systemcomprising left and right hearing assistance devices and an auxiliarydevice, e.g. a cellphone, the auxiliary device comprising a userinterface for the system, e.g. for viewing and (possibly) influencingthe (perceived) location of current sound sources in the environment ofthe binaural hearing assistance system, and

FIG. 5 shows a flow diagram of a method of operating a hearingassistance system (as e.g. shown in FIG. 3) comprising left and righthearing assistance devices.

The figures are schematic and simplified for clarity, and they just showdetails which are essential to the understanding of the disclosure,while other details are left out. Throughout, the same reference signsare used for identical or corresponding parts.

Further scope of applicability of the present disclosure will becomeapparent from the detailed description given hereinafter. However, itshould be understood that the detailed description and specificexamples, while indicating preferred embodiments of the disclosure, aregiven by way of illustration only. Other embodiments may become apparentto those skilled in the art from the following detailed description.

DETAILED DESCRIPTION OF EMBODIMENTS

FIG. 1 schematically illustrates various examples of a mutual locationin space of elements of a binaural hearing assistance system and/or asound source, represented in a spherical and an orthogonal coordinatesystem.

FIG. 1A defines coordinates of a spherical coordinate system (d, θ, φ)in an orthogonal coordinate system (x, y, z). A given point in threedimensional space (here illustrated by a location of sound source S_(s))whose location is represented by a vector d_(s) from the center of thecoordinate system (0, 0, 0) to the location (x_(s), y_(s), z_(s)) of thesound source S_(s) in the orthogonal coordinate system is represented byspherical coordinates (d_(s), θ_(s), φ_(s)), where d_(s), is the radialdistance to the sound source S_(s), θ_(s) is the (polar) angle from thez-axis of the orthogonal coordinate system (x, y, z) to the vectord_(s), and φ_(s)), is the (azimuth) angle from the x-axis to aprojection of the vector d_(s), in the xy-plane of the orthogonalcoordinate system.

FIG. 1B defines the location of left and right hearing assistancedevices HAD_(l), HAD_(r) (see FIG. 1C, 1D, here represented by left andright microphones mic_(l), mic_(r)) in orthogonal and sphericalcoordinates, respectively. The center (0, 0, 0) of the coordinatesystems can in principle be located anywhere, but is here (to utilizethe symmetry of the setup) assumed to be located midway between thelocation of the centers of the left and right microphones mic_(l),mic_(r), as illustrated in FIG. 1C, 1D. The location of the left andright microphones mic_(l), mic_(r) are defined by respective vectorsd_(l) and d_(r), which can be represented by respective sets ofrectangular and spherical coordinates (x_(l), y_(l), z_(l)), (d_(l),θ_(l), φ_(l)) and (x_(r), Y_(r), z_(r)), (d_(r), θ_(r), φ_(r)).

FIG. 1C defines the location of left and right hearing assistancedevices HAD_(l), HAD_(r) (here represented by left and right microphonesmic_(l), mic_(r)) relative to a sound source S_(s) in orthogonal andspherical coordinates, respectively. The center (0, 0, 0) of thecoordinate systems is assumed to be located midway between the locationof the centers of the left and right microphones mic_(l), mic_(r). Thelocation of the left and right microphones mic_(l), mic_(r). are definedby vectors d_(l) and d_(r), respectively. The location of the soundsource S_(s) is defined by vector d_(s) and orthogonal and sphericalcoordinates (x_(s), y_(s), z_(s)) and (d_(s), θ_(s), φ_(s)),respectively. The sound source S_(s) may e.g. illustrate a personspeaking (or otherwise expressing him or herself), a loudspeaker playingsound, or a wireless transmitter transmitting an audio signal to awireless receiver of one or both of the hearing assistance devices.

FIG. 1D defines a similar setup as shown in FIG. 1C. FIG. 1D illustratesa user U equipped with left and right hearing assistance devicesHAD_(l), HAD_(r) and a sound source S_(s) (e.g. a loudspeaker, as shown,or a person speaking) located in front, to the left of the user. Leftand right microphones mic_(l), mic_(r) of the left and right hearingassistance devices HAD_(l), HAD_(r) received time variant sound signalssound source S_(s). The sound signals are received by the respectivemicrophones and converted electric input signals and provided in a timefrequency representation in the form of (complex) digital signalsX_(sl)[n,k] and X_(sr)[n,k] in the left and right hearing assistancedevices HAD_(l), HAD_(r) (see also FIG. 3B), n being a time index and kbeing a frequency index. The directions of propagation of the soundwave-fronts from the sound source S_(s) to the respective left and rightmicrophones mic_(l), mic_(r) are indicated by lines (vectors) d_(sl) andd_(sr), respectively. The center (0, 0, 0) of the orthogonal coordinatesystem (x, y, z) is located midway between the left and right hearingassistance devices HAD_(l), HAD_(r), which are assumed to lie in thexy-plane (z=0, θ=90°) together with the sound source S_(s). Thedifferent distances, d_(sl) and d_(sr), from the sound source S_(s) tothe left and right hearing assistance devices HAD_(l), HAD_(r),respectively, account for different times of arrival of a given soundwave-front at the two microphones mic_(l), mic_(r), hence resulting inan ITD(d_(s), θ_(s), φ_(s)). Likewise the different constitution of thepropagation paths (the path to the right hearing assistance deviceHAD_(r) is influenced by the users' head (as indicated by the dottedline segment of the vector d_(sr)), the the path to the left hearingassistance device HAD_(l) is NOT) gives rise to different levels of thereceived signals at the two microphones mic_(l), mic_(r). In other wordsan ILD(d_(s), θ_(s), φ_(s)) is observed. These differences (that areperceived by a normally hearing person as localization cues) are to acertain extent (depending on the actual location of the microphones onthe hearing assistance device) reflected in the signals X_(sl)[n,k] andX_(sr)[n,k] and can be used to extract the head related transferfunctions for the given geometrical scenario point source located at(d_(s), θ_(s), φ_(s)).

FIG. 2 shows an embodiment of a binural hearing assistance systemcomprising left and right hearing assistance devices HAD_(l), HAD_(r),and an auxiliary device AD, e.g. an audio gateway, the system beingadapted for establishing a first (interaural) communication link IA-WLbetween the two hearing assistance devices as well as for establishing acommunication link WL-I between each or the two hearing assistancedevices and the auxiliary device. FIG. 2 shows an application scenarioof an embodiment of a binural hearing assistance system according to thepresent disclosure, wherein the auxiliary device (AD) comprises an audiogateway device, e.g. adapted for receiving a multitude of audio signalsfrom different sound sources (here only one source S_(l), entertainmentdevice (TV), is shown). Alternatively inputs from other acoustic and/orwirelessly transmitted audio sources, e.g. from a telephone apparatus,e.g. a mobile telephone, from a computer, e.g. a PC, or from an externalmicrophone (e.g. based on FM or Bluetooth transmission) for picking upsounds from the environment, e.g. the voice of another person, can bereceived by the auxiliary device (and/or one or both of the hearingassistance devices). The audio signals from sound source S_(l) arewirelessly transmitted to the left and right hearing assistance devicesHAD_(l), HAD_(r) (via the auxiliary device and links WL-RF and WL-I) ASWELL AS acoustically propagated by a loudspeaker of the entertainmentdevice TV. A further audio source S₂ in the form of a person speakingthereby creating sound source signals which are received at the left andright hearing assistance devices HAD_(l), HAD_(r). The geometricarrangement of the sound sources S₁ and S₂ relative to the left andright hearing assistance devices HAD_(l), HAD_(r) are illustrated withtheir different distance and propagation paths relative to the user'shead as explained in FIG. 1D. The two sound sources S₁ and S₂ arerepresented in the xyz-coordinate system by vectors d_(s1) and d_(s2),respectively. The propagation paths of the wave fronts of the acousticsignals of the two sound sources S₁ and S₂ are represented in thexyz-coordinate system by vector sets (d_(1l), d_(1r)) and (d_(2l),d_(2r)), respectively, where, as in FIG. 1D, the parts of the paths thatare influenced by head diffraction are indicated in dotted line.

The auxiliary device AD is adapted to be connected to the (different)sound source(s) via wireless links WL-RF, here in the form of digitaltransmission link(s) according to the Bluetooth standard as indicated bythe Bluetooth transceiver (BT-Rx-Tx) in the audio gateway device (AD).The audio sources and the audio gateway device may be paired using thebutton BT-pair on the auxiliary device. Once paired, the BT-address ofthe audio source may be stored in a memory of the audio gateway devicefor easy future pairing. The links to the audio sources mayalternatively or additionally be implemented in any other convenientwireless and/or wired manner, and according to any appropriatemodulation type or transmission standard, possibly different fordifferent audio sources. The auxiliary device may function as a remotecontrol of the binaural hearing assistance system. The intended mode ofoperation of the system can e.g. be selected by the user U via modeselection buttons Mode 1 and Mode 2. The auxiliary device AD may furtherhave the function of allowing a user to the change the currently activeprogram (e.g. telephone program, TV-listening program, normalconversation program, etc.) or changing operating parameters (e.g.volume, cf. Vol-button) in the hearing assistance devices, and/or forfully or partially powering the system down (or up).

In the embodiment of FIG. 2, the left and right hearing assistancedevices (HAD_(l), HAD_(r)) each additionally comprises a manuallyoperable user interface (UI), whereby the user is allowed to changeoperating conditions of each individual (or both) hearing instruments bymanual operation of the user interface (e.g. a push button), e.g. forchanging program or operating parameters (e.g. volume) or for poweringthe devices (fully or partially) down or up (i.e. turning devices on oroff).

The left and right hearing assistance devices (HAD_(l), HAD_(r)) areshown as devices mounted at the left and right ears of a user (U). Thehearing assistance devices of the system of FIG. 2 each comprises awireless transceiver, here indicated to be based on inductivecommunication (I-Rx). The transceiver (at least) comprises an inductivereceiver (i.e. an inductive coil, which is inductively coupled to acorresponding coil in a transceiver (I-Tx) of the audio gateway device(AD)), which is adapted to receive the audio signal from the audiogateway device (either as a baseband signal or as a modulated (analogueor digital) signal, and in the latter case to extract the audio signalfrom the modulated signal). The inductive links WL-I between theauxiliary device AD and each of the hearing instruments are indicated tobe one-way, but may alternatively be two-way (e.g. to be able toexchange control signals between transmitting (AD) and receiving(HAD_(l), HAD_(r)) device, e.g. to agree on an appropriate transmissionchannel, or to exchange other signals or parameters, e.g. audio signalsor localization parameters). Alternatively or additionally, the hearingassistance device(s) may be adapted to receive one or more audio signalsdirectly transmitted to the hearing assistance device(s) from othersound sources in the environment. The left and right hearing assistancedevices may e.g. be embodied in respective left and right hearinginstruments, each comprising a BTE-part (adapted for being locatedBehind The Ear (BTE) of the user) as shown in FIG. 2. Each of the leftand right hearing instrument may comprise one or more microphones(mic_(l) and mic_(r), respectively). One or both of the hearinginstruments may e.g. be adapted to compensate for a hearing impairmentof the user. Alternatively, the left and right hearing assistancedevices may comprise ear pieces for augmenting an acoustic and/orwirelessly received (possibly virtual) sound field ‘surrounding’ theuser U. The user U may be normally hearing or hearing impaired.

The auxiliary device (AD) is shown to be carried around the neck of theuser (U) in a neck-strap. The neck-strap may have the combined functionof a carrying strap and a loop antenna into which the audio signal fromthe auxiliary device is fed (directly by galvanic connection, orindirectly via an inductive coupling to a transmitting coil in theauxiliary device) for better inductive coupling to the inductivetransceiver of the listening device. Alternatively, the auxiliary deviceAD may be carried by the user U in any other way, e.g. held in a hand.

FIG. 3 shows an embodiment of a binaural hearing assistance systemcomprising first and second hearing assistance devices.

FIG. 3A shows an example of a binaural or a bilateral listening systemcomprising first and second hearing assistance devices HAD_(l), HAD_(r),each being e.g. a hearing assistance device as illustrated in FIG. 3B.The hearing assistance devices are adapted to exchange information viawireless link IA-WL and transceivers RxTx. The information that can beexchanged between the two hearing assistance devices comprises e.g.information (e.g. sound source localization information or HRTFs),control signals and/or audio signals (e.g. one or more (e.g. all)frequency bands of one or more audio signals). The first and secondhearing assistance devices HAD_(l), HAD_(r) of FIG. 1A are shown asBTE-type device, each comprising a housing adapted for being locatedbehind an ear (pinna) of a user, the hearing assistance devices eachcomprising one or more microphones, a signal processing unit and anoutput unit (e.g. a loudspeaker). In an embodiment, all of thesecomponents are located in the housing of the BTE-part. In such case thesound from the output transducer may be propagated to the ear canal ofthe user via a tube connected to a loudspeaker outlet of the BTE-part.The tube may be connected to an ear mould specifically adapted to theform of the users' ear canal and allowing sound signals from theloudspeaker to reach the ear drum of the ear in question. In anembodiment, the ear mould or other part located in or near the ear canalof the user comprises a microphone (e.g. located at the entrance to earcanal) which form part of the input unit of the corresponding hearingassistance device and thus may constitute one of the electric inputsignals that are used to separate the sound sources S_(s) in theenvironment from each other. Alternatively, the output transducer may belocated separately from the BTE-part, e.g. in the ear canal of the user,and electrically connected to the signal processing unit of the BTE-part(e.g. via electric conductors or a wireless link).

FIG. 3B shows an embodiment of a binaural or a bilateral hearingassistance system, e.g. a hearing aid system, comprising left and righthearing assistance devices (HAD_(l), HAD_(r)), in the following termedhearing instruments. The left and right hearing instruments are adaptedfor being located at or in left and right ears of a user. The hearinginstruments are adapted for exchanging information between them via awireless communication link, here via a specific inter-aural (IA)wireless link (IA-WL) implemented by corresponding antenna andtransceiver circuitry (IA-Rx/Tx-l and IA-Rx/Tx-r). of the left and righthearing instruments, respectively). The two hearing instruments(HAD_(l), HAD_(r)) are adapted to allow the exchange of audio sourcesignals X_(s) and localization parameters LP_(s) of the correspondingsource signals S_(s) between the two hearing instruments, cf. dottedarrows indicating a transfer of signals X_(s) ^(r), LP_(s) ^(r) from theright to the left instrument and signals X_(s) ^(l), LP_(s) ^(l) fromthe left to the right instruments. Each hearing instrument (HAD₁,HAD_(r)) comprise a forward signal path comprising an input unit(IU_(l), IU_(r)) operatively connected to a signal processing unit (SPU)and an output unit (here loudspeaker (SPK)). Between the input unit IUand the signal processing unit SPU, and in operative connection withboth, a source separation and localization unit (SEP-LOC) is located.The source separation and localization unit (SEP-LOC) is adapted toprovide separated sound source signals (X_(s) ^(l), X_(s) ^(r), s=1, 2,. . . N_(s)) and corresponding localization parameters (LP_(s) ^(l),LP_(s) ^(r), s=1, 2, . . . N_(s)) based on a number of electric inputsignals (INm1, INm2, INw) from the input unit (IU), each electric inputsignal representing a sound or audio signal. In the present embodiment,the electric input signals (INm1, INm2) are signals from two microphones(mic_(l1), mic_(l2) and mic_(r1), mic_(r2) of the left and right hearinginstruments, respectively) and (INw) from a wireless receiver comprisingantenna (ANT) and transceiver circuitry (RF-Rx/Tx-l and RF-Rx/Tx-r ofthe left and right instruments, respectively). The forward path furthercomprises a selector and mixer unit (SEL-MIX-HRTF) for selecting a givensource signal (X_(s) ^(l), X_(s) ^(r), s=1, 2, . . . N_(s)) or mixing anumber of source signals and providing a resulting input signal IN tothe signal processing unit (SPU). The hearing instruments furthercomprises a memory (HRTF_(l), HRTF_(r)) for storing a database of headrelated transfer functions HRTF and a calculation and comparator unit(COMP) for determining a HRTF of a current sound source S_(s) (from thecurrently received separated sound source signals X_(s) ^(l) and X_(s)^(r), of the left and right hearing instruments, respectively) andcomparing such current values with values stored in the database. Thecalculation and comparator unit (COMP) is configured to update thecorresponding HRTF-value of the database according to a predefinedlearning rule (e.g. controlled via a control signal crit from the signalprocessing unit SPU). The selector and mixer unit (SEL-MIX-HRTF) isconfigured to access the memory (HRTF_(l), HRTF_(r)) and to apply anappropriate HRTF to a currently received sound source signal (e.g. onlyto a signal selected for further processing), cf. signal hrtf_(l) andhrtf_(r) in the left and right hearing instruments, respectively. In thebinaural hearing assistance system of FIG. 3B, signals X_(s) ^(r),LP_(s) ^(r) and signals X_(s) ^(l), LP_(s) ^(l) are transmitted viabi-directional wireless link IA-WL from the right to the left and fromthe left to the right hearing instruments, respectively. These signalsare received and extracted by the respective antenna (ANT) andtransceiver circuitry (IA-Rx/Tx-l and IA-Rx/Tx-r) and forwarded to therespective signal processing units (SPU) of the opposite hearinginstrument as signals DBS. The source signal and localization data(X_(s) ^(l), LP_(s) ^(l)) received in the right hearing instrument(HAD_(r)) from the left hearing instrument (HAD_(l)) can be forwardedfrom the signal processing unit (SPU) to the HRTF-database (HRTF_(r)) ofthe right hearing instrument (HAD_(r)) via signal dbs. Likewise, sourcesignal and localization data (X_(s) ^(r), LP_(s) ^(r)) can be extractedfrom the HRTF-database (HRTF_(r)) of the right hearing instrument(HAD_(r)) and forwarded to the left hearing instrument (HAD_(l)) viasignal dbs, signal processing unit SPU, signal DBS, antenna andtransceiver circuitry (IA-Rx/Tx-r) of the right hearing instrument andwireless link IA-WL. The source signal and/or localization parametersfrom the local and the opposite hearing instrument can be used togetherto update the respective HRTF-databases and to apply localization cuesprovided by the relevant HRFT-values for the selected resulting inputsignal(s) in the left and right hearing instruments. Each (or one ofthe) hearing instruments comprises a manually operable and/or a remotelyoperable user interface (UI) for generating a control signal UC, e.g.for providing a user input to one or more or the signal processing unit(SPU), the HRTF-database (HRTF_(l), HRTF_(r)), the selector and mixerunit (SEL-MIX-HRTF) and the separation and localization unit (SEP-LOC)(e.g. for selecting a target signal among a number of signals in thesound field picked up by the input unit (IU)). In an embodiment, a givensound source can be ‘relocated’ via the user interface, so that it isperceived as originating at a location determined by the user, suchlocation possibly being virtual (e.g. allocated to a directly receivedaudio input signal) and/or deviating from the physical location of thesound source as determined by the separation and localization unit(SEP-LOC) (e.g. originating from a speaker in the environment of theuser). Such user interface is discussed in connection with FIG. 4.

FIG. 4 shows an embodiment of a binaural hearing assistance systemcomprising left and right hearing assistance devices (HAD_(l), HAD_(r))and an auxiliary device (AD), e.g. a cellphone, the auxiliary devicecomprising a user interface (UI) for the system, e.g. for viewing and(possibly) influencing the (perceived) location of current sound sources(S_(s)) in the environment of the binaural hearing assistance system.

The left and right hearing assistance devices (HAD_(l), HAD_(r)) aree.g. implemented as described in connection with FIG. 3. In theembodiment of FIG. 4, the binaural hearing assistance system comprisesan auxiliary device (AD) in the form of or comprising a cellphone, e.g.a SmartPhone. The left and right hearing assistance devices (HAD_(l),HAD_(r)) and the auxiliary device (AD) each comprise relevant antennaand transceiver circuitry for establishing wireless communication linksbetween the hearing assistance devices (link IA-WL) as well as betweenat least one of or each of the hearing assistance devices and theauxiliary device (link WL-RF). The antenna and transceiver circuitry ineach of the left and right hearing assistance devices necessary forestablishing the two links is denoted RF-IA-RX/Tx-l, and RF-IA-RX/Tx-r,respectively, in FIG. 4. Each of the left and right hearing assistancedevices (HAD_(l), HAD_(r)) comprises a respective database of headrelated transfer functions (HRTF_(l), HRTF_(r)). In an embodiment, theinteraural link IA-WL is based on near-field communication (e.g. oninductive coupling), but may alternatively be based on radiated fields(e.g. according to the Bluetooth standard, and/or be based on audiotransmission utilizing the Bluetooth Low Energy standard). In anembodiment, the link WL-RF between the auxiliary device and the hearingassistance devices is based on radiated fields (e.g. according to theBluetooth standard, and/or based on audio transmission utilizing theBluetooth Low Energy standard), but may alternatively be based onnear-field communication (e.g. on inductive coupling). The bandwidth ofthe links (IA-WL, WL-RF) is preferably adapted to allow sound sourcesignals (or at least parts thereof, e.g. selected frequency bands and/ortime segments) and/or localization parameters identifying a currentlocation of a sound source to be transferred between the devices. In anembodiment, processing of the system (e.g. sound source separation)and/or the function of a remote control is fully or partiallyimplemented in the auxiliary device AD (SmartPhone). In an embodiment,the user interface UI is implemented by the SmartPhone possibly runningan APP allowing to control the functionality of the audio processingdevice via the SmartPhone, e.g. utilizing a display of the SmartPhone toimplement a graphical interface (e.g. combined with text entry options).

In an embodiment, the binaural hearing assistance system is configuredto allow a user to modify a location of a sound source whose locationhas been determined by the source separation unit (or receivedseparately for a wirelessly received direct electric signal) via theuser interface and to apply the HRTF values to the sound source signal,the HRTF values being extracted from the HRTF database corresponding tothe modified location of the sound source. As illustrated in FIG. 4, alocation of the sound sources as defined by the separation andlocalization unit may be displayed by the user interface (UI) of theSmartPhone (which is convenient for viewing and interaction via a touchsensitive display, when the Smartphone is held in a hand (Hand) of theuser (U)). The sound sources S_(s) displayed by the user interface maye.g. be limited by a, e.g. user defined, criterion, e.g. including alldetected, or the currently loudest, or those currently containingspeech, and/or those currently containing music, or those currentlycontaining noise (e.g. uncorrelated sound, and/or sound identified notto be speech and not to be music), etc. In the illustrated example inFIG. 4, the locality of 3 sound sources S₁, S₂ and S₃ (as represented byrespective vectors d₁, d₂, and d₃ in the indicated orthogonal coordinatesystem (x, y, z) having its center between the respective microphoneunits (mic_(s), mic_(r)) of the left and right hearing assistancedevices) are displayed relative to the user (U). In the example of FIG.4, a new sound source S₄ has been detected (e.g. a wirelessly receiveddirect electric audio signal source), and the user interface UI isconfigured to allow the user to spatially place the new source in thecurrent sound source arrangement according to wish (e.g. by dragging thesource symbol to the left of text indication ‘S₄’ and dropping it at anappropriate location relative to the user). The binaural hearingassistance system (including the auxiliary device) is configured todetermine and transmit localization parameters LP₄ corresponding to thelocation of S₄ as proposed by the user via the user interface to theleft and right hearing assistance devices (HAD_(l), HAD_(r)) of thebinaural hearing assistance system. The binaural hearing assistancesystem (including the left and right hearing assistance devices) isadapted to receive the localization parameters LP₄ and to applycorresponding head related transfer functions HRTF (HRTF_(l)(LP₄),HRTF_(r)(LP₄)) to the sound source signal S₄ in the left and righthearing assistance devices, respectively. Additionally, the user isallowed to manipulate the sound field by placing one or more soundsources at another position than its/their physical (or otherwiseproposed) location.

Various aspects of inductive communication links (IA-WL) are e.g.discussed in EP 1 107 472 A2, EP 1 777 644 A1, US 2005/0110700 A1, andUS2011222621A1. WO 2005/055654 and WO 2005/053179 describe variousaspects of a hearing aid comprising an induction coil for inductivecommunication with other units. A protocol for use in an inductivecommunication link is e.g. described in US 2005/0255843 A1.

In an embodiment, the RF-communication link (WL-RF) is based on classicBluetooth as specified by the Bluetooth Special Interest Group (SIG)(cf. e.g. https://www.bluetooth.org). In an embodiment, the (second)RF-communication link is based other standard or proprietary protocols(e.g. a modified version of Bluetooth, e.g. Bluetooth Low Energymodified to comprise an audio layer).

FIG. 5 shows a flow diagram of a method of operating a hearingassistance system (as e.g. shown in FIG. 3) comprising left and righthearing assistance devices. The method comprises in each of the left andright hearing assistance devices the steps shown in FIG. 5.

The invention is defined by the features of the independent claim(s).Preferred embodiments are defined in the dependent claims. Any referencenumerals in the claims are intended to be non-limiting for their scope.

Some preferred embodiments have been shown in the foregoing, but itshould be stressed that the invention is not limited to these, but maybe embodied in other ways within the subject-matter defined in thefollowing claims and equivalents thereof.

REFERENCES

-   [Gardner and Martin, 1994] Gardner, Bill and Martin, Kieth, HRTF    Measurements of a KEMAR Dummy-Head Microphone, MIT Media Lab Machine    Listening Group, MA, US, 1994.-   [Dillon; 2001] Dillon H. (2001), Hearing Aids, Thieme, New    York-Stuttgart, 2001.-   WO2010115227A1 (COCHLEAR) Oct. 14, 2010-   US2004218771A1 (SAT) Apr. 11, 2004-   WO2009001277A1 (PHILIPS) Dec. 31, 2008-   EP2563045A1 (OTICON) Feb. 27, 2013-   [Schaub; 2008] Arthur Schaub, Digital hearing Aids, Thieme Medical.    Pub., 2008.-   EP1107472A2 (SONY) Jun. 13, 2001-   EP1777644A1 (OTICON) May 24, 2007-   US20050110700A1 (STARKEY/OTICON) May 26, 2005-   US2011222621A1 (OTICON) Sep. 15, 2011-   WO2005055654 (STARKEY/OTICON) Jun. 16, 2005-   WO2005053179 (STARKEY/OTICON) Jun. 9, 2005-   US20050255843A1 (STARKEY/OTICON) Nov. 17, 2005

1. A non-transitory storage medium storing a processor-executableprogram that, when executed by a processor of an auxiliary device,implements a user interface process for a binaural hearing assistancesystem including left and right hearing assistance devices, the processcomprising: exchanging information with the left and right hearingassistance devices; providing a graphical interface configured toillustrate one or more currently active sound sources relative to theuser; and executing, based on input from a user via the user interface,at least one of: modifying a location of a sound source, the location ofthe sound source having been determined by source separation; andplacing a sound source for a wirelessly received direct electric signalat an appropriate location relative to the user.
 2. The non-transitorystorage medium according to claim 1, wherein the user interface isconfigured to allow a user to select a suitable position of a soundsource relative to the user.
 3. The non-transitory storage mediumaccording to claim 2, wherein the process further comprises: updatinglocalization parameters of a sound source in a memory unit of the leftand right hearing assistance devices, based on user input to the userinterface.
 4. The non-transitory storage medium according to claim 1,the process further comprising: allowing a user, based on user input tothe user interface, to select a particular sound source signal to beincluded in an output signal from at least one of the hearing assistancedevices to the user.
 5. The non-transitory storage medium according toclaim 1, the process further comprising: extracting localizationparameters that represent perceived location of a specific sound.
 6. Thenon-transitory storage medium according to claim 1, the process furthercomprising: extracting localization parameters embedded in an audiosignal representing a sound source signal.
 7. The non-transitory storagemedium according to claim 1, wherein sound sources displayed by the userinterface are limited by a user defined criterion.
 8. The non-transitorystorage medium according to claim 7 wherein the user define criterioncomprises one of the following options: include all detected soundsources, include the currently loudest sound sources, include the soundsources currently containing speech, include the sound sources currentlycontaining music, include the sound sources currently containing noiseinclude the sound sources currently containing uncorrelated sound,include the sound source identified not to be speech and not to bemusic, or a mixture thereof.
 9. The non-transitory storage mediumaccording to claim 1, wherein the user interface is configured to allowthe user, based on input to the user interface, to spatially place a newsource in the current sound source arrangement by dragging a soundsource symbol from a current location and dropping it at an appropriatelocation relative to the user.
 10. The non-transitory storage mediumaccording to claim 1, the process further comprising: determining andtransmitting localization parameters corresponding to the location of asound source as proposed by the user via the user interface to the leftand right hearing assistance devices of the binaural hearing assistancesystem.
 11. An auxiliary device comprising: a user interface for abinaural hearing assistance system that includes left and right hearingassistance devices adapted for being located at or in a left and rightear, respectively, of a user, wherein the user interface generates agraphical interface configured to illustrate a currently active soundsource relative to the user, and, based on input from the user via theuser interface, allowing a user to perform at least one of: modifying alocation of a sound source, the location of the sound source having beendetermined by source separation; and placing a sound source for awirelessly received direct electric signal at an appropriate locationrelative to the user.
 12. The auxiliary device according to claim 11,wherein said auxiliary device is a remote control or a smartphone. 13.The auxiliary device according to claim 12, wherein the user interfaceis a remote control or smartphone executing a software program.
 14. Theauxiliary device according to claim 11, wherein the device is configuredto establish a communication link with the left and right hearingassistance devices to exchange information with the left and righthearing assistance devices.
 15. The auxiliary device according to claim11, further comprising: a localization unit, which estimates theposition of a sound source by means other than the sound signal.
 16. Theauxiliary device according to claim 11, further comprising: an antennaand transceiver for receiving a signal comprising localizationparameters.
 17. An auxiliary device configured to execute a program toimplement a user interface process for a binaural hearing assistancesystem including left and right hearing assistance devices, the processcomprising: exchanging information with the left and right hearingassistance devices; providing a graphical interface configured toillustrate one or more currently active sound sources relative to theuser; and executing, based on input from a user via the user interface,at least one of: modifying a location of a sound source, the location ofthe sound source having been determined by source separation; andplacing a sound source for a wirelessly received direct electric signalat an appropriate location relative to the user.
 18. A binaural hearingassistance system, comprising: left and right hearing assistance devicesadapted for being located at or in a left and right ear, respectively,of a user, each of the left and right hearing assistance devices,comprising: an input unit for providing one or more electric inputsignals based on one or more input sounds of a sound field surroundingthe binaural hearing assistance system, a signal processing unit forprocessing an input signal selected among said electric input signals,or a mixture thereof, and providing a processed output signal, and anoutput unit for providing output stimuli to the user based on theprocessed signal, wherein said output stimuli are perceived by the useras sound; and an auxiliary device according to claim
 11. 19. Thebinaural hearing assistance system according to claim 18, wherein theauxiliary device receives localization parameters and appliescorresponding head related transfer functions (HRTF) to a selected soundsource signal in the left and right hearing assistance devices,respectively.
 20. The binaural hearing assistance system according toclaim 18, wherein the auxiliary device applies hear related transferfunctions (HRTF) values to a sound source signal whose location has beenmodified via the user interface, the HRTF values being extracted from aHRTF database corresponding to a modified location of the sound source.21. The binaural hearing assistance system according to claim 18,wherein the auxiliary device allows the user to manipulate the soundfield by placing one or more sound sources at a position other thanits/their physical or otherwise proposed location.
 22. The binauralhearing assistance system according to claim 18, wherein the auxiliarydevice allows a user to relocate a sound source via the user interfaceof the auxiliary device, so that the sound source is perceived asoriginating at a location determined by the user.
 23. A method forimplementing a user interface on an auxiliary device for a binauralhearing assistance system including left and right hearing assistancedevices, the method comprising: exchanging information with the left andright hearing assistance devices; providing a graphical interfaceconfigured to illustrate one or more currently active sound sourcesrelative to the user; and executing, based on input from a user via theuser interface, at least one of: modifying a location of a sound source,the location of the sound source having been determined by sourceseparation; and placing a sound source for a wirelessly received directelectric signal at an appropriate location relative to the user.